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DETAILED ACTION 
Election/Restrictions 

[1] This application contains claims directed to the following patentably distinct species: 

1. Species I: Image exposure correction corresponding to claims 1-7, 11, 12, 1 4- 
18, 21 and 23. 

2. Species II: Image exposure correction in a Bayer array corresponding to claims 
840,13,19, 20 and 22. 

[2] The species are independent or distinct because each species receives a separate classification 
species I is classified in 382/274 and species II is classified in 348/222,1. 

[3] Applicant is required under 35 U.S.C. 121 to elect a single disclosed species for prosecution 
on the merits to which the claims shall be restricted if no generic claim is finally held to be allowable. 
Currendy, 1, 4, 5, 11, 14 and 16 are generic. 

[4] Applicant is advised that a reply to this requirement must include an identification of the 
species that is elected consonant with this reqviirement, and a listing of all claims readable thereon, 
including any claims subsequendy added. An argument that a claim is allowable or that all claims are 
generic is considered nonresponsive unless accompanied by an election. 

[5] Upon the allowance of a generic claim, applicant will be entided to consideration of claims 
to additional species which depend from or otherwise require all the limitations of an allowable 
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generic claim as provided by 37 CFR 1.141. If claims are added after the election, applicant must 
indicate which are readable upon the elected species. MPEP § 809.02(a). 

[6] During a telephone conversation with Mr. Robert lannucci (Reg. No. 33,514) on July 16, 
2007 a provisional election was made without traverse to prosecute the invention of species I, claims 
1-7, 1 1, 12, 14-18, 21 and 23. Affirmation of this election must be made by applicant in replying to 
this Office action. Claims 8-10, 13, 19, 20 and 22 withdrawn from further consideration by the 
examiner, 37 CFR 1.142(b), as being drawn to a non-elected invention. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on sale in 
this country, more than one year prior to the date of application for patent in the United States. 

[7] Claims 1,11,14 and 23 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Takeshima*. 

Regarding claim 1, Takeshima meets the claim limitations, as follows: 

A digital image processing method ffig. //, comprising the steps of: extracting 
chromatic information (i.e, R-Y and B-Y) of an image taken by an image taking device 
and related to a human subject [coL 3, IL 29-32]; detecting (ie. 1) visually interesting 
regions (ue, skin area) in the taken image by recognizing areas corresponding to skin 
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of the subject, wherein the recogni2ed areas are the visually interesting regions [col: 3, 
IL 32A2]\ and correcting an exposxire (ue. 6) of said taken image by normalizing a 



Regarding claims 14 and 23, all claimed limitations are set forth and rejected as per 
discussion for claim 1. 

Regarding claim 11, Takeshima meets the claim limitations, as follows: 

A digital image processing method according to claim 1, further comprising a final 
color reconstruction step [fig, 1; output of 5 and 6]. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 



grey scale (u, Y) of said taken image based on said visually interesting regions (Le. 



skin) [col 4, II 1-5], 



[8] 



Claims 2, 3 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable over 



Takeshima' in view of TerriUon et al. ("TerriUon")" further in view of Hsu et al ("Hsu")*"- 



Regarding claim 2, Takeshima meets the claim limitations as set forth in claim 1 . 
Takeshima does not explicidy disclose the following claim limitations: 
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A digital image processing method according to claim 1, wherein said recognizing 
step comprises constructing a probabilistic slicing of said image taken in a YcrCb 
format to evaluate if pixels of said image must be classified as belonging to said areas 
corresponding to the skin of said subject. 

However, in the same field of endeavor TerriUon discloses the deficient claim limitations, as 

follows: 

A method for recognizing skin [abstract] comprising: constructing a probabilistic 
slicing (ie. single Gaussian model) of said image taken in a TSL format to evaluate if 
pixels of said image must be classified as belonging to said areas corresponding to 
the skin of said subject [page 2, col. 2, para. 1-3]. 

Takeshima and Terrillon do not explicidy disclose the following claim limitation: 
The image being in the YCrCb format. 

However, in the same field of endeavor Hsu discloses the deficient claim limitations, as 

follows: 

The image being in the YCrCb format [page 697, col. 2, para. 1]. 
It would have been obvious to one with ordinary skiU in the art at the time of invention to 
modify the teachings of Takeshima and incorporate the skin detection method of Terrillon, 
the motivation being robustoess to illumination changes [Terrillon: page 1, col. 2, para. 1]. It 
would have been ftirther obvious to one with ordinary skill in the art at the time of invention 
to have an image in the YCrCb format, the motivation being compressed images use this 
color space and it is also similar to TSL [Hsu: page 697, col. 2, para. 1]. 

Regarding claim 3, TerriUon meets the claim limitations (in view of claim 2), as follows: 
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A digital image processing method according to claim 2, wherein pixels with higher 
grey values (ie, 1) are classified as belonging to said areas corresponding to the skin 
of said photographed subject [page 3, coL 1,para. 1j. 

Regarding claim 15, all claimed limitations are set forth and rejected as per discussion for 
claim 3. 

[9] Claims 4-7 and 16-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Takeshima* in view of Soriano et al. ("Soriano")*''. 

Regarding claim 4, Takeshima meets the claim limitations as set forth in claim 1. 

Takeshima does not explicidy disclose the following claim limitations: 

A digital image processing method according to claim 1, wherein said recognizing 
step comprises applying a threshold area of said image taken in an RGB format to 
evaluate if pixels of said image must be classified as belonging to said areas 
corresponding to the skin of said subject. 

However, in the same field of endeavor Soriano discloses the deficient claim limitations, as 

follows: 

A digital image processing method according to claim 1, wherein said recognizing 
step comprises applying a threshold area (Le, eq, 1) of said image taken in an RGB 
format to evaluate if pixels of said image must be classified as belonging to said areas 
corresponding to the skin (Le. Skin(rjg)'=1) of said subject ^age 840, coL 2, para. 5]. 
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It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Takeshima and incorporate the skin detection method of Soriano, 
the motivation being robustoess to illumination changes [Soriano: abstract]. 

Regarding claim 5 Soriano meets the claim limitations (in view of claim 4), as follows: 
A digital image processing method according to claim 4, wherein applying said 
threshold area comprises constructing a chrominance slicing histogram (Le, S(r^) of 
said taken image [page 840, coL 1,para, 3J. 

Regarding claim 6 Soriano meets the claim limitations (in view of claim 5), as follows: 

A digital image processing method according to claim 5, wherein constructing said 
chrominance slicing histogram uses normalized channels r and g of the type: 
r=R/(R+G+B) g=G/(R+G+B) R, G and B being red, green and blue values of each 
pixel of said taken RGB image Ipage 840, col 1,para. 2], 

Regarding claim 7 Soriano meets the claim limitations (in view of claim 5), as follows: 

A digital image processing method according to claim 5, wherein said recognizing 
step uses said chrominance slicing histogram (ie, S(r^) to detect said areas 
corresponding to the skin of said subject formed by the pixels of said taken image 
belonging in said chrominance slicing histogram to said threshold area [f>age 840, col 
1,para. 3], 
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Regarding claims 16-18, all claimed limitations are set forth and rejected as per discussion for 
claims 4-7. 

[10] Claims 12 and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable over Takeshima* 
in view of Sakaue et al. ("Sakaue'y. 

Regarding claim 12, Takeshima meets the claim limitations as set forth in claim 11. 

Takeshima does not explicidy disclose the following claim limitations: 

A digital image processing method according to claim 11, said image being taken in 
an RGB format, wherein said final color reconstruction step comprises the relations: 
R^ = 0.5(Y7Y(R + Y) + R-Y) G * = 0.5 ( Y ' /Y ( G + Y) + G - Y) 
B' = 0.5(Y'/Y(B + Y) + B-Y) 

R, G, B, and Y being respective red, green, blue, and luminance values of said taken 
image, Y* being a desired luminance value, and R', G*, and B' being respective red, 
green, and blue values of the image after said final color reconstruction step. 

However, in the same field of endeavor Sakaue discloses the deficient claim limitations, as 

foUows: 

A digital image processing method according to claim 1 1 , said image being taken in 
an RGB format, wherein said final color reconstruction step comprises the relations: 
R' = 0.5(Y7Y(R + Y) + R-Y) G ' = 0.5 ( Y* /Y (G + Y) + G - Y) 
B' = 0.5(Y VY(B + Y) H-B-Y) 
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R, G, B, and Y being respective red, green, blue, and luminance values of said taken 
image, Y* being a desired luminance value, and R', G*, and B' being respective red, 
green, and blue values of the image after said final color reconstruction step [page 
558, coL 1,para. // 

It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Takeshima and incorporate the correction method of Sakaue, the 
motivation being to minimize change in color saturation /Sakaue;/)^?^^ 557, coL 2, para, 2]. 



Regarding claim 21, aU claimed limitations are set forth and rejected as per discussion for 
claims 12. 

Contact Irtformation 
[11] Any inquiry concerning this communication or earlier conununications from the examiner 
should be directed to Mr. Sath V. Perungavoor whose telephone number is (571) 272-7455. The 
examiner can normally be reached on Monday to Friday fcom 8:30am to 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's isupervisor, 
Mr. Matthew C. Bella whose telephone number is (571) 272-7778, can be reached on Monday to 
Friday from 9:00am to 5:00pm. The fax phone nvimber for the organization where this application 
or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system. 
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see http://pair-directuspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Matthew C. Bella 
Sath V. Perungavoor 
Telephone: (571) 272-7455 



i US 5,585,860 

NPL document titled, "Comparative Performance of Different Skin Chrominance Models and Chrominance Spaces 
for tlie Automatic Detection of Human Faces in Color Images". 
"* NPL document tided, "Face Detection in Color Images". 

NPL document tiled, "Skin detection in video under changing illumination conditions". 
V NPL document tided, "Adaptive Gamma Processing of the Video Cameras for the Expansion of the Dynamic Range' 
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